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A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) OR THIRTY (30) DAYS, 
WHICHEVER IS LONGER, FROM THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .1 36(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1)K Responsive to communication(s) filed on 04 May 2007 . 
2a)S This action is FINAL. 2b)D This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 

Disposition of Claims 

4) ^3 Claim(s) 1-20 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s)_ is/are allowed. 

6) M Claim(s) 1-20 is/are rejected. 

7) D Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10) E3 The drawing(s) filed on 10 October 2003 is/are: a)M accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 

11) D The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C. § 119 

12) D Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f). 
a)D All b)D Some * c)D None of: 

1 .□ Certified copies of the priority documents have been received. 

2. D Certified copies of the priority documents have been received in Application No. . 

3. D Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 
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DETAILED ACTION 

1. Applicant's response to the last office action filed on 05/04/2007 has been 
entered and made of record. 

Remarks 

2. The applicant's arguments in respect to the "Top-hat" on pages 10-12 are 
considered. The applicant is arguing about Hardeberg not teaching "Tophat" 
operation and the examiner disagrees. Hardeberg discloses performing the 
"Tophat" operation on the pixels in (Fig 2 Element 220, Col 3 Lines 63-67 and 
Col 4 Lines 1-6) where the reflected light artifacts are the concentrations of red 
in the image. The detailed explanation with respect to "Tophat" will follow in the 
rejection below. 

3. The applicant argues on Page 13 Lines 8-12 that Hardeberg does not disclose 
regarding the filtering on the Grayscale data, the examiner disagrees. Hardeberg 
discloses at (Col 8 Lines 10-24) the grayscale levels. 

4. The applicant argues on Page 13 Lines 19-22, that Hardeberg does not 
conduct intensity threshold operation and the examiner disagrees. Hardeberg 
discloses performing the intensity threshold operation at (Col 4 Lines 7-21). 
The yielding of mask containing one or more circular blobs (segmented mask) is 
the result of the intensity threshold operation. 
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Examiner cites particular columns and line numbers in the references as 
applied to the claims below for the convenience of the applicant. Although the 
specified citations are representative of the teachings in the art and are applied 
to the specific limitations within the individual claim, other passages and figures 
may apply as well. It is respectfully requested that, in preparing responses, the 
applicant fully consider the references in entirety as potentially teaching all or 
part of the claimed invention, as well as the context of the passage as taught by 
the prior art or disclosed by the examiner 



Claim Rejections - 35 USC § 102 



The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 
A person shall be entitled to a patent unless - 

(e) the invention was described in (1) an application for patent, published under section 122(b), by 
another filed in the United States before the invention by the applicant for patent or (2) a patent 
granted on an application for patent by another filed in the United States before the invention by the 
applicant for patent, except that an international application filed under the treaty defined in section 
351(a) shall have the effects for purposes of this subsection of an application filed in the United States 
only if the international application designated the United States and was published under Article 21(2) 
of such treaty in the English language. 

Claims 1-3,5-10 and 12-20 are rejected under 35U.S.C 102(e) as anticipated by 
Hardeberg (US 6728401) hereafter Hardeberg. 



5. Regarding Claim 1, Hardeberg discloses a method of correcting a red-eye 
effect in a digital image provided by a cluster of pixels (Fig 2), the method 
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comprising: (a) conducting at least one tophat operation over each pixel in the 
digital image to provide a tophat image at (Fig 2 Element 220, Col 3 Lines 63- 
67 and Col 4 Lines 1-6). The reflected light artifacts (concentrations of red) 
are highlighted using a manual or automated process; (b) conducting an intensity 
threshold operation on the tophat image to provide a segmentation mask for 
segmenting objects in the digital image at (Col 4 Lines 7-22). The yielding of 
mask containing one or more circular blobs (segmented mask) is the result of 
the intensity threshold operation; (c) for each segmented object in the 
segmentation mask, extracting at least one feature from at least one of the 
segmented object (circular-shaped blobs) and a border region surrounding the 
segmented object and classifying the segmented object based on the at least 
one feature (red color characteristics) at (Col 4 Lines 22-39); and (d) for each 
segmented object in the segmentation mask classified as red-eye effect in step 
(c), correcting the red-eye effect by re-coloring the segmented object to generate 
a corrected image at (Col 4 Lines 39-50). 

6. Regarding Claim 2, Hardeberg discloses the method as defined in claim 1 
wherein the tophat image is a dark tophat image, and the tophat operation 
comprises the steps of: conducting at least one greyscale dilation operation over 
each pixel in the digital image to provide a dilated image at (Fig 7 Elements 750- 
760 and Col 8 Lines 37-49); conducting at least one greyscale erosion operation 
over each pixel in the dilated image to provide an eroded image at (Fig 7 
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Element 770and Col 8 Lines 37-49); and, subtracting the digital image from the 
eroded image to provide the dark tophat image at (Col 8 Lines 42-49). 
Hardeberg discloses that the application of steps 760 and 770 is called the 
closing operation, which eliminates (subtracts) holes and fills gaps in contours. 

7. Regarding Claim 3, Hardeberg discloses the method as defined in claim 1 
wherein the tophat image is a bright tophat image, and the tophat operation 
comprises the steps of: conducting at least one greyscale erosion operation over 
each pixel in the digital image to provide an eroded image at (Fig 7 Elements 
720-730 and Col 8 Lines 25-32); conducting at least one greyscale dilation 
operation over each pixel in the eroded image to provide a dilated image at (Fig 
7 Element 740 and Col 8 Lines 25-33); and, subtracting the dilated image from 
the digital image to provide the bright tophat image at (Col 8 Lines 32-37). 
Hardeberg discloses that the application of steps 730 and 740 is called the 
opening operation, which eliminates (subtracts) thin protrusions, breaks narrow 
isthmuses and smoothes contours of the image. 

8. Regarding Claim 5, Hardeberg discloses the method as defined in claim 1 
wherein step (b) comprises, after intensity thresholding the bright tophat image, 
filtering out objects having compactness below a threshold level of compactness 
to provide the segmentation mask at (Col 8 Lines 50-58). Hardeberg discloses 
that pixels corresponding to white portions of the mask are changed to shades of 
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gray where the saturation of these pixels is changed to zero (threshold) and the 
saturation of pixels corresponding with gray portions of the mask is reduced 
(filtered). 

9. Regarding Claim 6, Hardeberg discloses the method as defined in claim 1 
wherein step (c) comprises, for each segmented object in the segmentation 
mask, after extracting the at least one feature (Col 7 Lines 32-41), comparing the 
at least one feature with a paradigmatic red-eye feature cluster to determine an 
associated probability that the segmented object is a red-eye defect (Col 7 Lines 
42-51), and classifying the segmented object as a red-eye defect if and only if the 
associated probability exceeds a threshold probability at (Col 7 Lines 52-67 and 
Col 8 Lines 1-9). Hardeberg also discloses that a conservative threshold is 
selected to correctly identify the red-eye defects and exclude the pinkish and 
reddish regions near the corner of the eye. 

10. Regarding Claim 7, Hardeberg discloses the method as defined in claim 1 
further comprising selecting the digital image from an initial image at (Fig 2 
Element 220). 

11. Claim 8 is a corresponding system claim of a method of Claim 1. See the 
explanation of Claim 1 and also see (Fig 1). Hardeberg discloses the system at 
(Col 3 Lines 45-51). 
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12. Claim 9 is a corresponding system claim of a method of Claim 2. See the 
explanation of Claim 2 and also see (Fig 1). Hardeberg discloses the system at 
(Col 3 Lines 45-51). 

13. Claim 10 is a corresponding system claim of a method of Claim 3. See the 
explanation of Claim 3 and also see (Fig 1). Hardeberg discloses the system at 
(Col 3 Lines 45-51). 

14. Claim 12 is a corresponding system claim of a method of Claim 5. See the 
explanation of Claim 5 and also see (Fig 1). Hardeberg discloses the system at 
(Col 3 Lines 45-51). Hardeberg also discloses that algorithms can be written to 
select the threshold manually or automatically at (Col 7 Lines 8-11). 

15. Claim 13 is a corresponding system claim of a method of Claim 6. See the 
explanation of Claim 6 and also see (Fig 1). Hardeberg discloses the system at 
(Col 3 Lines 45-51). Hardeberg also discloses that algorithms can be written to 
select the threshold manually or automatically at (Col 7 Lines 8-11). 

16. Regarding Claim 14, Hardeberg discloses the system as defined in claim 8 
further comprising a display for displaying initial image; and a user-operable 
selection means for selecting the digital image from the large image in (Fig 1 and 
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2). The selection of ROI is selecting a region from a larger image. 

17. Claim 15 is a corresponding system claim of a method of Claims 6 and 13. 
See the explanation of Claims 6 and 13 and also see (Fig 1). Hardeberg 
discloses the system at (Col 3 Lines 45-51). Hardeberg also discloses that 
algorithms can be written to select the threshold manually or automatically at 
(Col 7 Lines 8-11). 

18. Claim 16 is a corresponding system claim of a method of Claim 1 . See the 
explanation of Claim 1 and also see (Fig 1). Hardeberg discloses the system at 
(Col 3 Lines 45-51). Hardeberg also discloses the user selectable input section 
170 and elements 140 and 145 for the detection and correction of the redeye 
defect. 

19. Claim 17 is a corresponding Computer program product of the method of 
Claim 1. See the explanation of Claim 1 and also (Fig 1, Col 3 Lines 45-51). 

20. Claim 18 is a corresponding Computer program product of the method of 
Claim 2. See the explanation of Claim 2 and also (Fig 1, Col 3 Lines 45-51). 

21. Claim 19 is a corresponding Computer program product of the method of 
Claim 3. See the explanation of Claim 3 and also (Fig 1, Col 3 Lines 45-51). 



Application/Control Number: 10/682,364 



Art Unit: 2624 



Page 9 



22. Claim 20 is a corresponding Computer program product of the method of 
Claim 5. See the explanation of Claim 5 and also (Fig 1, Col 3 Lines 45-51). 

Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

Claims 4,1 1 rejected under 35 U.S.C. 103(a) as being unpatentable over 

Hardeberg in view of Benati et al.(US 5748764) hereafter Benati 

23. Regarding Claim 4, Hardeberg discloses, a method as defined in claim 1, and 
Hardeberg is silent about the image being a low-resolution image at the detection 
stage. An enlarged ROI in Fig 3a shows that it is a low-resolution image. 

Benati discloses detecting and correcting red eye defect being done at 
various levels of resolutions at (Col 2, Lines 44-47 and Col 3, Lines 46-62). 
Both Hardeberg and Benati are analogous art, therefore it would have been 
obvious for one of ordinary skill in the art, at the time the invention was made to 
include the detection and correction of red eye defects at different resolution and 
more particularly at (low resolution) as taught by Benati in the Red-Eye removal 
image processing of Hardeberg. 
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24. Claim 11 is a corresponding system Claim of the method of Claim 4. See the 
explanation of Claim 4. 

Conclusion 

THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 .136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed 
within TWO MONTHS of the mailing date of this final action and the advisory 
action is not mailed until after the end of the THREE-MONTH shortened statutory 
period, then the shortened statutory period will expire on the date the advisory 
action is mailed, and any extension fee pursuant to 37 CFR 1 .136(a) will be 
calculated from the mailing date of the advisory action. In no event, however, will 
the statutory period for reply expire later than SIX MONTHS from the mailing 
date of this final action. 

Any inquiry concerning this communication or earlier communications from 
the examiner should be directed to Jayesh A. Patel whose telephone number is 
571-270-1227. The examiner can normally be reached on M-F 7.00am to 4.30 
pm (5-4-9). If attempts to reach the examiner by telephone are unsuccessful, the 
examiner's supervisor, Jingge Wu can be reached on 571-272-7429. The fax 
phone number for the organization where this application or proceeding is 
assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from 
the Patent Application Information Retrieval (PAIR) system. Status information 
for published applications may be obtained from either Private PAIR or Public 
PAIR. Status information for unpublished applications is available through 
Private PAIR only. For more information about the PAIR system, see http://pair- 
direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll- 
free). If you would like assistance from a USPTO Customer Service 
Representative or access to the automated information system, call 800-786- 
9199 (IN USA OR CANADA) or 571-272-1000. 

Jayesh Patel 
06/21/2007 
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